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S.  Geman  and  Chi  R.  Hwang  (Z.  Wahrscheinlichkeistheoria  verw.  Gehiete, 
1942)  proposed  a  kind  of  algebraic  system  of  equations  and  proved  the  law 
of  large  numbers  for  its  solution.  In  this  paper,  the  conditions  to  ensure 
these  results  are  significantly  weakened  for  the  law  of  large  numbers.  Al<  .1, 
the  central  limit  theorem  is  shown.  For  both  the  law  of  large  numbers  and 
the  limit  theorem,  the  only  needed  assumption  is  that  the  random  variables 
have  finite  second  moment. 


1 .  INTRODUCTION 


LeC  (u)  },  i,j  -  1,2,...,  be  a  collection  of  independent  and 

identically  distributed  random  variables  with  zero  mean.  For  each 
n,  n  -  1,2,...,  define  to  be  the  n*n  matrix  whose  (i,j)  entry  is 

7 

Given  a  sequence  a^.c^,...,  define  for  each  n,  ■  (a^  , . . .  ,0^)  . 

T 

Finally,  for  each  n,  define  a  random  vector  X  *  (X  , ,X  „, . . . ,X  )  as 

n  ni  nz  nn 

the  solution  to  the  equation 


X  =  V  +  -  W  x 
n  n  n  n  n 


(1.1) 


1  n 

i.e.  X  *  a  +  —  T  oj 

n,i  i  n  ^  ij 


Xnj,  j  -  1.2.. ...n. 


This  system  of  equations  plays  an  improtant  rule  in  large  and 
homogeneous  systems  of  physics  (see  [1]  and  [2]).  When  n  is  large 
enough,  the  solution  of  (1.1)  is  usually  assumed  being  "nearly  inde¬ 
pendent"  (the  so-called  chaos  hypothesis).  This  hypothesis  was  first 
proved  by  S.  Geman  and  Chi  R.  Hwang.  They  usually  assume  that 

g 

Eu>j^<  “.  For  some  stronger  conclusions,  it  is  even  assumed  that  the 
characteristic  function  of  has  a  nondegenerate  analytic  zone. 

In  this  paper,  we  relax  all  these  restrictions  to  the  existence 
of  the  second  moment  of  w  ^  and  prove  somewhat  stronger  conclusions 
than  that  are  shown  in  [1].  Exactly  speaking,  we  get  the  following 
theorems. 

Theorem  1.  Define  X  by  (1.1)  whenever  I  -  —  W  is  nonsingular. 

n  n  n 

2 

Otherwise,  define  X  ■  0.  Suppose  that  Eo>^  “  0  and  Eu^  <  00 . 

then 

h,  i  '  “i1- 


1)  If  (^^*^2* ' ' ^  K »  then 


2)  If  lim  a 
n  n 


max  [  X 
l<i<n 

0,  then 

n 


0,  a.s.  n 


(1.2) 


l  <xn  i  -  ai>'‘ 
i-1  ’  1 


0,  a.s.  n 


(1.3) 


(1.4 


especially  for  (o  ,a2>...)  e 

( Xn  ^  i  *  •  *  i  Xn  i  ^2 1  •  •  •)  in  S>2 1  a  •  s  • 

If  ■  <>2  *•••’  a  and  if  Eu>^  ■  m  (instead  of  zero),  Geman  and 

Hwang  proved  X^^  -*■  a/l-m  a.s.  under  the  conditions  that  |m|  <1  and 
o  gn 

E  |  o>ii  |  n  ,  V  n  <_  2,  for  some  positive  constant  8.  Corresponding 
to  this,  we  have 

Theorem  2.  Assume  a  =  *  ...»  Ern^  =  m>  Define  X^  by 

(1.1)  whenever  1  -  W  is  nonsingular  and  define  X  *  0  otherwise. 

n  n  *  n 

If  m  4  1  and  Em.2,  <  »  then  max  lx  ,  -  — —  |  -*•  0.  a.s. 

^  l<i<n  ni  1_m 

For  the  CLT  of  X  ,  we  have 
n 

2  i 

Theorem  3.  If  =  0,  0  <  Ew^  -  a2  <  »,  (a  a-,...)  e  l ce, 

and  \  *  00 .  Then  for  any  given  integers  (m  <  m„  <...<  m  ), 

i=»l  1  12  K. 


where  I,  denotes  the  kx  k  unit  matrix. 


2.  SOME  LEMMAS 


We  firsC  prove  some  lemmas. 

2 

Lemma  2.1.  If  Ew^  00 •  then  |  |  (“0  |  [  ■*•  0  a.s. 
where  the  norm  means  the  Euclidean  one,  i.e.,  for  A  *  (a^). 


1*11  -  <2  I  a,?)4- 


Proof .  |  |  (S&4 


*  £  ‘  l  ““  V’ 


J1(n)  +  J2(n)  +  J3(n)  +  J4<n) 


where 


Ji(n) "  b  J.  “ii4  ( 

i=l 

J2(n)  "7*  { J  (“y“ji  +  2  +  2  ( 

J3(n)"7t{jj  l  “ik“kj  }  ( 

J4(n>  "  n  {I  <*iika)ki<“ih“hi  +  2  Jh  “ik^kj “ih“hj 

i*k  i*k 

141 

+  2  i>j  i>h  ( 

j^h 

It  is  easy  to  see  that 

E  J4(n)  -  0 

E  J.  (n)  <  — v  (Eu.^)4. 

4  —  n  ii 

By  Chebyshev  inequality  and  Borel-Cantelli  lemma,  we  obtain  that 
J4(n)  ->•  0  .  a.s  .  ( 

By  Marcinkiewicz  strong  law  of  large  numbers ,  we  have 

J1(n)  -  0  ( ^2)  .  a.s.  ( 

and  l/.22«/l\  „  ( 

^  i*i  “ij“ji  °(?)  •  a'S*  ( 


4 


?  .1 


l((~0  l  U).  <4)is((~4>  I  0J.?01.?> 


li  ij  ji1 


n-  ii 


i h  ij  jl 


n 


-  ^n3  ^  “ii  *  ^  I  *) 

i-1  11  n  ij  ji 


I°(n>  ]1S  Mp)]1* 


0(n  '3//2)  a.s. 


and 


1 

7* 


ij 


-  “i2i“»2),i  ij  “«>ls 

i  (n2  J1  “li)(^  l  “i3)1S 


o^HOd))1* 


0( — ) .  a.s. 
n 


hence 


J_(n)  «  0  (— ) .  a.s. 
l  n 


To  prove  J^(n)  ->■  0.  a.s.  we  define 


wijn  ""ij  It|Uij|  <  n] 


7 .2  r.  2 

J  .  ,  m  Ui  .  .  E.  CO.  . 

ijn  ijn  "ijn 


and 


J3(n)  r?  J  l  “ikn  "kjn 
i>  j  k 


J3(n)  =  f-  J.  I  “ikn  ^kjn 
i>j  k 


~7~ 


Notice  that  E  -  °,  E  -  0  and  that  to^  ,  u^jn 

of  each  other  for  given  i  >  j  and  k,  we  know 


are 


E  J^Cn)  *  0 


E(J. (n) ) 2  *  8  I  I  ^EWln  ^2 


i>  j  k 


lln 


<  An"5  t  E  o,-^  ]2 

—  11  n 

<  A  Eu n  E  “n  n 


h 


(2.9) 


(2.10) 


(2.11) 


independent 


and 


Therefore,  for  any  e  >  0,  we  have 


l  P(|J3(n)|  >  e)  <  «  Eu^  e~  I  n"  E  i»n 
n«l  n-1 

®  -  n 

<  c  T  n  (V  k2  E  li.J  I.,  ,  I  21  ii.  t) 
-  n-l  k-1  11  in  i  KJI  <  k]  +  1' 

CO  00 

*  c  [1  +  y  k2  E  iii  2  I,.  ,  I  2  1  ..I  I  n^] 

k-1  11  Ik-1!  I -ill  <  kl  nik 

00 

<c[l+j  E  01,  f  I  r.  ,  1  2  t  111 

k-1  11  tk'1  -  I “ill  <  k] 

_<  c  [1  +  E  <  00 • 


(2.12) 


here  and  after,  c  denotes  a  positive  constant  independent  of  n  or  k, 


but  it  may  take  different  value  in  each  appearance. 

From  (2.12)  we  get 

J^(n)  -►  0.  a.s.  (2.13) 

* 

On  the  other  hand,  noticing  E  n  !  E  we  have 

I  -Mn)  -  JVn>  I  1~U  I  I  l  Cn-i)  u)|  1+^4  l  [  (J-U 

J  J  i-1  k-1  j-2  k-1  2 


< £ j  y  2  c 

—  n3£  £  id  ‘  +  — 

1  k  ik  n 


0.,  a.s. 


(2.14) 


here  the  first  term  tends  to  zero  from  Kolmogorov's  strong 

law  of  large  numbers.  From  (2.13)  (2.14)  it  follows  that 

lim  J^(n)  =  0.  a.s. 
n-**> 

Finally,  we  prove  that 


(2.15) 


P(J3(n)  +  J3(n),  i.o)  -  0. 


We  have 


Tit  T  t'rx'S  -l  T  /-N  4  ^  1  4  w»  3 

r  4..W/  J.X411  £ 


Hjh  \  r(  \^j  (J^(u)  r  J^vkO) 

m“k  2m_1<n<2m 
n  .  n  .  — 


llim  I  P(  m-H  m  0  U  <KJ  >  n>> 

k~»  m-k  2m  A<n< 2™  i-1  j-1  2 


k-*»  m-k  2  <n<2  i-1  1-1 


6 


2m  .2“ 


li®  I  P(U  O  <  U±1 1  >  2“  » 

k-w  m=k  i=l  j-1 


<  11m  I  22m  Pduuj  >  2“  *) 
k-+®  m-k 


1  j 

,m-l. 


11m  l  22m  l  P(2Jt-J‘  < 


i-l‘ 


k r*»  m-k  £=m 

ao 

.1-1 


J11 1 


<  2l) 


11m  l  P<2  1  Un!  <  2*)  J 


,2m 


k^0  £=k 


m-k 


<_  lim  2  J  2U  P(2*“A  £ 

k^-oo  £  =  k 


.1-1 


<  2  )  <  lim  2  E  (A)1?  Iri 
11  ~  fc**  11  11  “11 


(2.16) 


which  and  (2.14)  prove 

J^(n)  •+•  0.  a.s. 


(2.17) 


(2.17)  and  (2.1)  (2.6)  (2.7)  (2.11)  complete  the  proof  of  Lemma  2.1. 

Lemma  2.1  implies  that  for  almost  all  u>,  when  n  is  large  enough, 
we  have 


i  ii<f)kiii  i on  I  iu“)2nk 

k-0  n  n  k-0  n 


00 

+  I 

k-0 


Hence  we  obtain 

Lemma  2.2.  If  E  -  0,  E  uj <  »,  then,  almost  surely, 

00 

(I  -  ^-)  ^  exists  and  equals  £  (-^_)  »  w^en  n  Is  sufficiently  large. 


3.  THE  PROOF  OF  MAIN  RESULTS 


3.1.  The  proof  of  Theorem  1. 


Firstly,  we  shall  prove 


lim  -  W  V 
1  '  n  n  n1 

n-*» 


“  0  a.s.  if  lim  a  -  0 

n 

n-*-00 

_<  M  w^2,  a.s.  if  sup  |a  |  <_  M 

n 


(3.1) 


We  have 


|— ■  W  V  [|2  = 
'n  n  n‘ 1 


n  n 

n2  l  (  ^  ai  “ki^ 
k-1  i=l  1 


.  n  n  ,  n 

— -2  T  y  a2  (u.  2  +  — 2  I  I  a  a.  w  w 

“  i  ki  n2,^,  i  j  ki  kj 


k-1  i=l 


k-1  i>j 


Ij.(n)  +  I2(n)  . 


(3.2) 


By  Kolmogorov's  strong  law  of  large  numbers,  we  have  for  any  m 

Il<n)  1~2  ( M2  ( 1 )  l  l  wk2  +  M(m)  l  I  wki  } 
k-1  i-1  k=l  i-m+1 

- -  M2(m)  E  w^2.  a.s. 

where  M(m)  -  sup  | a^J  M,  m  =  1,2,...  .  From  this  we  can  easily  see 


lim  I^(n) 

n-*00 


if  lim  a  =  0, 


<_  M  E  m  2 ,  a.s.  if  sup  |  a  [  <_  M 
11  n  n 


(3.3) 


n 

Z  -  l 
n  k- 


I  V 

1  n>i>i>l 


.  W,  .(i).  .  . 

j  ki  kj 


Noting  that  (Zn>  n  -  1,2,...}  forms  a  martingale  sequence,  by  a  well- 


known  martingale  Inequality,  we  get  for  any  e  >  0 


8 


P(  max  r2  |Znl  i  e)  <.  P(  max  |z  |  >_  f-  22m) 
om  n  n  l<n<2m  **  ® 


2®“J-<n<2® 


177  2-’“E(Z  )2 


82  -4m 

e"2"  2m 

=  82  r2  2'4m 

k-1  2®>i>j>l 


f  i  «i«:  (e^); 
-1  2®>1>1>1  3 


. -m 
<  c  2  . 


from  which  and  Borel-Cantelli  lemma,  it  follows  that 


I,(n)  =  — 2  Z - ►  0.  a.s. 


L2V  '  n‘  n 
By  (3.2)  (3.3)  (3.4)  we  get  (3.1). 
Next  we  shall  prove  that 

IKf)2vo|| - .  0.  .... 

We  have 


(3.4) 


(3.5) 


-*{  L  ““  (ii  "‘k“k>2  +  ji  jr«“Jk“k>!; 


We  shall  first  prove  that 


max 


n“3  C  I 


l<^l<n  k-1 

If  we  have  done  so,  then 


“ik V 


0.  a.s. 


(3.6) 

(3.7) 


2 


I  ut\  (  l  wlkak)2  1  2(~  I  uJ)  (max  n  3(  £  ) 


u<i  '  i.  Ullk“k'  —  ‘■'■n  i  Bjj'  k  k  L  <0.v“u 

i-1  11  k=l  lk  k  n  i-1  11  l<i<n  k-1  lk  k 


-*•  2  E  ^2  .0-0.  a.s. 


(3.8) 


Noting  that  {  £  u  ,a,  ,  n  -  1,2,...}  forms  a  martingale  sequence,  we 
k-1  lk  k 


have  for  any  e  >  0 


P(  max 


max 


n  3  (  l  u>. toi.  > 2  >_  e) 


2®*i<n<2m  l<i<n 


i-1 


ik  k 


<  2m  P(  max  (  [  >  e  •  8  1  2~3m). 

2®-l<n<2®  i-1  ik  k  ” 


om 

<  c  2"2m  E(  I  <^ikak)2  <.  c  M2(l)  2 


i-1 


-®  .  c  2>®. 


(3.9) 


which  and  Borel-Cantelli  lemma  Imply  (3.7).  Hence,  (3.8)  holds 


On  the  other  hand,  we  have 


n  n  n 


n~  1(1  l  “ij“jkak)S 

i-1  j-1  k-1 


"I  ' k  +  2}J2  "«1  k  jx  jx  "ft  ,“»* 


-  n  4  (R^(n)  +  R2(n)} 


(3.10) 


Since 


we  have 


E(n  R2(n))2  <_  c  n  , 


n  ^  R2  (n) 


0.  a. e. 


(3.11) 


Noticing  that  {  £  £  “ik  °k  °k  *  n  1,2,...)  forms  a 

nik1>k2— 1  1  2  12 

martingale  sequence,  we  obtain 

P(  max  max  n  2  £  £  “-iU  “-lie  akak  — 

2m-l<n<2m  l<j<n  n^k^k^l  3  1  3  2  12 

<  2®  P(  max  |  l  l  u>  oj  a  a  |  >_  ^  e  22m) 
n<2">  n>k1>k2>l  lkl  lk2  1  2 

ic2‘3mEL?.?.,  «...  vv>2 


2m>k1>k2il  lkx  “lk2  1  2 


<  c  2-m, 


which  ensures  that 


max  n-2  |  £  I  u>  .  u ..  a.  (  -►  0  a.s.  (3.12) 

<1<n  n>k, >k«>l  jkl  jk2  kl  k2 


1  2— ' 


Thus,  to  prove  n-4  R1(n)  0  a.s.  we  only  need  to  prove 


(3.13) 


10 


Since  |o^|  £  M,  it  follows  that  we  only  need  to  prove 


-4 


n  n 


l  l  ^k-l^ii^lk 
1-1  j-l,J*i  jk 


0.  a.s, 


n  n  n 

This  can  be  easily  seen  from  the  facts  that  {  T  T  V  m  2m  2 

i-i  i-i.jh  ik-1  « 

n  -  1,2,...}  forms  a  semi-martingale  sequence  and  that 

p(  max  n"4|  [  £  £  |  >  e) 

2m~l<n<2m  i*l  j-l,jf«i  k  1  i;J  lk 

I  l  l  £,  ..?•  i  2'4  «  24*) 

n<2®  i-1  j-l.jVi  *  1  IJ  Jk 

2®  2m  2n 

I  c  2-4"  E  I  I  . 

j-i.jyi  k-i  Jk 


(3.13) 


,-m 


<  c  2 

From  (3.6),  (3.7),  (3.10),  (3.11)  and  (3.13),  we  obtain  (3.5). 
By  Lemma  2.2,  for  almost  all  id,  it  holds  that 

*»  -  v„  ■  <t>  «  -  i  «”>'1  \  -  f  <?>k  v„ 

k“l 


-  <>„  *  l  <v>  v 

^  ix  2  ^  ix 

If  lim  a  ■  0,  by  (3.1),  (3.5)  and  (3.16),  we  obtain 
n  n 


(3.16) 


2  .  > 


ll*„-v„ll  i  (IKv^nll  +  llC>  Vnll>  Ills'll  -0.  a 

k’°  (3.17) 

which  is  equivalent  to  the  second  assertion  of  Theorem  1.  Since 

HI  <^)k»JI  i  ll<v)2vnll  l  ||(^)2||k+  |l^vn||  £  11(257 

k“2  k=0  kj^l 

- *■  0.  a.s.  (3.18) 


to  prove  the  first  assertion  of  Theorem  1,  we  only  need  to  prove 
i  ,  n 

a  |  — *■  0.  a.s.  (3.19) 


n 

. — ' 

> 

-t 

a 

a 

max 

|— •  I  (D 

l<i<n  n  n  n  1 

l<i<n 

n  j-i 

or  equivalently, 

n 

max  1  —2 
n 

(i,  “«  V*1 

0.  a.s. 


(3.20) 


In  view  of  (3.12),  we  only  need  to  prove 


max  | 
l<_i<n 


— 2  Y  u)  2a  2  I 
^  j£l  «  J1 


-2 

<_  M2(l)  max  n  £  w  2 
l<_i<n  j-1 


Ol  a.s. 

(3.21) 


Set 


Zjn  "  “ij  1  n]  ~  E  Ifla)11l  I"] 

When  m  is  so  large  that  E  u^2  /  2m  <  we  have 

-2  n 

P(  max  max  n  £  w  2  e) 

2m_1<n<2m  l<±<n  j-1 

<  2mP(  max  7  (to  ?  —  E  Iri,»  I  i)  >  ■§■  22  ) 

~  2<”“l<n<2“  j-1  ij  11  U“nl<n] 


1  2m[P(  max  l  Z  >|22“)+P(  U  (J  (J  (l^l  > 

2m_l<n<2m  j-1  in  8  2m_1<n<  2m  i-1  j-1 

2m  2m 

1  2m  [2-3m  E  Z2  +  P(l^J  ( |co  |  >  2m~l))  ] 

2m  i-1  j-1  J 

<2  E  I[|COii|  <  2m]  +  2  P(lwnl  >  2m  1).  (3.22) 

where  e  is  an  arbitrarily  preasa^ned  positive  number. 

From  (2.16)  we  know 

OD  m 

l  22  P(|«  J  >  2m_1)  <  ». 


-in  r 


m-l 

On  the  other  hand  we  have 
_2m  r  4 


11 1 


(3.23) 


Ji  2"2m  E  1tl“lxt  i  2»]  ■  Ji  2  2“  1 X  E  “li  1  tz*1-1  <  l«ul 


i  ,1,  E  “ll  I[2k-1  <  |u,,|  <  2k)  _L  2  +1 


k-1 


11' 


m-k 


2k 

i2^2 


£  2  E  +  1  <:  ®. 


(3.24) 


From  (3.22),  (3.23),  (3.24)  and  Borel-Cantelli  lemma,  it  follows  that 

n 


max 


_2 

n  y  w  2  — ►  0.  a.s. 


l<i<n  j-1 


U 


(3.25) 


The  proof  of  Theorem  1  is  completed . 


12 


3.2.  The  proof  of  Theorem  2. 

Let  Mr  be  the  n  *  n  matrix  with  all  its  entries  being  m  ■  E 

and  let  W  ■  W  -  M  .  Write  y  ■  X  -  V  /(l-m)  =  (X  ,  ,  ...,X  -7—-) 

nnn  nnn  n,l  1-m  nn  1-m 

Then  (1.1)  can  be  rewritten  as 

Wn  .a  ;.  , 

y  *  —  y  +  —rz — r-  W  I 

n  n  n  n(l-m)  n 

T 

where  1  ■  (1,1  ,...,1)  being  an  n*l  vector. 

Let  | | A| | Q  denote  the  operator  norm  of  the  matrix  A.  Since 

W  =>  W  +  M  ,  we  have 
nnn’ 

llO2|l0i  llO2ll0+  ll^ll0+  ll^ll0+  l!#ll0. 

(3.26) 

Applying  lemma  2.1,  we  have 


Il0>2||  i  110*11 

n  0  n 


0.  a.s. , 


(3.27) 


where  I  I A I  I  denotes  the  Euclidean  norm  of  the  matrix  A.  We  can  easily 


compute  that 


Furthermore,  we  have 


1  Mn I  I  _  m 

n  0“  ft 


(3.28) 


-  iiOOn2 

2  n  n  n  ^  2  2^  n  A  2 

-  Sr  l  I  (  l  l  (  l  “ik5  * 

n  i»l  j-1  k-1  1  i«l  k-1  1 


(3.29) 


where  a  ran^°®  variable  with  zero  mean.  Applying 


(3.12)  with  ■...■  1,  ve  have 


4|  I  l  “,V  I 

^  i=X  kjJkj  lkl  ‘Y 


<_  2m  max  n  |  £  u-jv0Jiki"*’®‘  a,s' 

l<i<n  n>k.>k_>l  1K1  2 
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By  Kolmogorov's  strong  law  of  large  numbers,  we  have 


2  n  n  „ 

Hr  I  I  »lt2 

n  i-1  k*l 


0*  Var(w^)  -  0.  a.s. 


(3.31) 


From  (3.29),  (3.30)  and  (3.31)  wa  get 


0.  a. 8. 


(3.32) 


Similarly,  we  can  prove  that 


0.  a.s. 


(3.33) 


From  (3.26),  (3.27),  (3.28),  (3.32)  and  (3.33),  we  conclude  that 


(~>  II 
n  0 


0  •  Q  •  S  • 


(3.34) 


Like  proving  Lemma  2.2,  we  see  that  for  almost  all  w,  (I-—)-1  is 

n 


nonsingular  and 


(i  _  w»)-i  -  y  («v 

n  k-0  n 

when  n  is  sufficiently  large.  Thus,  for  almost  all  w,  when  n  is  large 


enough , 


r  -  <1  -  ’f)'1  (f2-  a.  1  ) 

n  n  1-m  n 

-7^  l  (f>k  (f>  *  • 

1-m  n  n 


(3.35) 


Since 


^2  l  l 

i-1  J-l 


0.  a.s.  (from  Marcinkiewicz  theorem) 


we  have 


Ilf  f  ?  |  f  -  m2n~3  (  f  l  ^  )2-> 

n  n  i-1  j-l  13 

from  which  and  (3.5)  we  conclude  that 

II  £  \  Ml  «  ll(f)2i||  +  Ilf  f ! 


0 .  a .  8 . 


(3.36) 


0.  a. 8.  (3.37) 


Applying  (3.1)  with  M  -  1,  we  have 


lio  |  |f  1 1  |  1  Z*  wu,  a.s. 
n-*» 


(3.38) 


VI 


We  have 


n  ,Wn 


2  .  .2 


irrrr  (?  VJ 


Jn?  ii  (Ji  I  w*>: 


i -t2— -~ i  l  “ii(lvi)2+  I  (I  I  -ij-jtV2) 

n2||vj|2  1-1  11  £-1  U  4  1-1  j-1  t-1  ij  * 

-Trr-nr { ?  “iK +  ?  “ii ( 5  uV2  +  !  < !  !  - 

n2 1  |  V  |  | 2  1-1  111  1-1  11  £-1  U  1  1-1  j-1  £-1  J  J 

“  £#  j?*i 


J1(n)  +  J2(n)  +  J3(n) 


It  Is  obvious  that 


(3.43) 


J^(n)  4  n  £  o»  ^  — ►  0.  a.s.  (see,  Marclnkiewicz  theore  ) 

i*1  (3.44) 


Hence 


E  J2(n)  5  4(E  “L2)2  /  n  — -  0, 


E  J3(n)  <_  4(E  u^)  . 


- -  V  ||  -  0  (1),  n 

IT  I  I  11  ^  P 


(3.45) 


(3.46) 


(3.47) 


where  "||X  ||  -0  (1),  n  -*■  ®"  means  that  the  sequence  (X  ,  n  -  1,2,...} 
n  p  “ 

are  uniformly  bounded  in  probability  in  the  sense  of  Euclidean  norm. 

Since  |  |^|  |  -  \  \  <*>2  E  a^2,  a.s. 

1-1  j-1 


we  have 


n  ,WnN3 


O  VIiUtII 


n  ,Wn 


(“)  Vjl  -  0  (1),  n  -*■  ®, 


which  and  (3.47)  and  Lemma  2.1  Imply 
ii  n  r  /Wn^ *  „  i i  ^  f ii  n 


rrtrr  ,L  <v>‘  -  ‘"ntn  (^v»"  +  "^t  (i?,3v»ll, 


*2n  i  ii<f-)2iil 


0 .  in  p . 


(3.48) 


By  (3.41),  (3.42),  (3.48),  to  prove  Theorem  3,  we  only  need  to  prov 


2—  (— )  V 

ii  n  n 


0.  in  p.  4  =  2,3,  j-1,2 , . . . ,k 


(3.49) 


Since  for  each  4 ,  ~-jj  (~)1  Vq  ,  j  -  1,2 . k,  are  identically 


distributed,  we  only  need  to  prove  (3.49)  for  j  *  1. 
For  £  -  2,  we  have 


— - W  2  V 


n||Vn|| 


r1—  l  l  “u  “ii  ai 


1  n| |vj j  i-1  £-1 


£  n  n  n 

— 7  {uliiai  +  “ii  £  “iA  +  £  I  “n  “j.  V 

V  11  1  11  4-2  11  1  i-2  2,-1  11 


Jx(n)  +  J2(n)  +  J3(n) 


(3.50) 


It  is  obvious  that 


lJl<n)|  <  iU] 


0.  a.s. 


E(J_(n) ) 


n  ?  (E  wii) 

^  I  «/(HVl>  1— T1- 


n2||Vn||2  4-2 


(3.51) 


(3.52) 


E(J^(n) )  -  I  I  «£2  (E  ^J)2 


n2||vn||2  i-2  £-1 


(E  u,^)2 


(3.53) 


From  (3.52)  and  (3.53),  we  obtain 


J2(n) 


0.  a.s. 


J3(n) 


0,  in  p . 


which  and  (3.51)  imply  (3.49)  for  4-2. 
For  i  -  3  we  have 


-n  (MS.)3  v  I 

llvjl  n  n| 


n  n  n 


7—  n  i  “ 


1  n2| jVn| |  i-1  4-1  m-1 


li  “ii  “im  am 


i—  »u  «ti  +  I(2)  "li  “li  “t„ 


+  ^ (3)  “li  “ii  “im  am  * 


(3.54) 


where  2,  (2)  runs  over  c^e  set  (i»£,m);  2  ^  i  ^  n,  l<^£,m<^n, 
two  of  (i,£,nO  are  equal  to  each  other,  but  the  other  one  is  not  equal  to 
them.),  and  1^)  runs  over  the  set  {  (i,Jt,m),  2  <_  i  <_  n,  1  <_  i,  m  n, 
any  two  of  (i,&,m)  are  not  equal  to  each  other.} 


It  is  obvious  that 


»2l|vJ 


“11  “1 


- -  £  u  o,  < 

1..  1  1  ,  ~  li  ii  i  — 


nz  V  i-2 


”11%! 


eIoj^xI  e 


1  r 

E  -  ) /rsK  w,  wA  a  < 

n2 1  |  v  ||  (2)  11  U  im  m  ” 


3ME|a.11|  EWn2 


E  ( - - -  T/,v  u).  ui  id  a  )  <  (E»  2)3  /  n2 

n2 1  |  V  ||  11  11  fcm  “  ~  11 


where  M  is  the  super  bound  of  the  sequence  {a^.c^  , . . ,  which  and  (3.54) 
imply  (3.49)  for  l  m  3 ,  and  the  proof  of  Theorem  3  is  proved. 
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